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ESTIMATES  AND  APPROXIMATE  CONFIDENCE  LIMITS  FOR  'LOG)  NORMAL  LIFE  DISTRIBUTIONS 
FROM  SINGLY  CENSORED  SAMPLES  BY  MAXIMUM  LIKELIHOOD 


Josef  Schmee  and  Wayne  Nelson 

Union  College  and  General  Electric  Co.  Corp.  Research  and  Development 

Schenectady,  NY  12345 


SUMMARY 

This  report  presents  a simple  table  for  maximum  likelihood  estimates  of 
the  parameters  of  a normal  or  lognormal  life  distribution  when  the  data  are 
analyzed  before  all  test  units  fail.  The  report  also  presents  a table  of  the 
large-sample  variances  and  covariances  of  the  parameter  estimates;  the  report 
shows  how  to  use  this  table  to  obtain  approximate  confidence  limits  for  the 
parameters  and  other  quantities,  such  as  failure  probabilities.  An  example 
on  the  life  of  locomotive  controls  illustrates  the  use  of  the  tables. 

J..  INTRODUCTION 

Life  test  data  can  be  analyzed  before  all  test  units  fail.  This  is 
cheaper  and  quicker  than  running  all  units  to  failure.  Often  test  units  are 
started  and  run  together.  If  the  test  data  are  analyzed  after  a fixed  time, 
the  data  are  called  singly  time  censored  (also.  Type  I censored)  on  the  right. 
Then  the  number  of  units  failing  by  that  time  in  random.  If  the  data  are 
analyzed  when  a prespecified  number  of  failures  occurs,  the  data  are  called 
singly  failure  censored  (also.  Type  II  censored)  on  the  right.  Then  the  length 
of  the  test  is  random. 

Cohen  (1961)  and  Cooley  and  Cohen  (1970)  give  a simple  table  for  maximum 
likelihood  (ML)  estimates  of  the  parameters  of  a normal  or  lognormal  life  dis- 
tribution fitted  to  such  data  censored  on  the  left;  it  can  be  adapted  to  data 
censored  on  the  right.  Our  report  extends  their  table.  In  simulating  such 
samples,  we  often  got  samples  outside  their  tables.  For  example,  for  samples 
with  5 observed  failures  out  of  10  on  test,  we  found  that  30%  of  the  samples 
fell  outside  their  tables.  Our  table  applies  directly  to  right  censored  data; 
so  it  is  more  convenient  for  life  data.  Also,  our  table  extends  to  samples 
with  smaller  observed  fractions  failing  and  has  convenient  fractions  1/3,  2/3, 
1/6,  etc. 
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Below,  y and  a denote  the  mean  and  standard  deviation  of  the  normal  life 
distribution.  Also,  y and  O denote  the  parameters  of  a lognormal  life  distri- 
bution; then  y and  O are  the  mean  and  standard  deviation  of  the  log  of 
life.  To  analyze  lognormal  data,  one  works  with  the  logs 
of  the  data  and  treats  them  as  if  they  come  from  a normal  distribution.  The 
normal  and  lognormal  distributions  and  their  relationship  are  described  in  de- 
tail by  Aitchison  and  Brown  (1957),  Hahn  and  Shapiro  (1967),  Johnson  and  Kotz 
(1970),  and  Nelson  (1974). 

2.  CALCULATION  OF  ML  ESTIMATES 

This  section  explains  how  to  calculate  the  ML  estimates  of  y,  O,  and  other 
quantities . 

Suppose  the  sample  contains  p.  units,  and  the  first  r failure  times  are 
observed.  Denote  the  ordered  failure  times  by  £ ...  £ y^.  For  a time 
censored  sample,  the  unfailed  units  run  a prespecified  time  yQ  £ y^.  For  a 
failure  censored  sample,  the  unfailed  units  run  a time  yQ  = y^_.  Hereafter, 
y^  denotes  the  running  time  for  both  types  of  censoring. 

Parameter  estimates.  First  calculate  the  sample  mean  y and  "variance"  v 
of  just  the  r failure  times  as 

y = (y1+...+yr)/r,  (2.1) 

v = [(y.,-y)2+. ..+(yr-y)2]/r  ; (2.2) 

both  are  divided  by  r.  Then  calculate  the  fraction  censored 

h = (n-r)/n  (2.3) 

and 

Y = v/ (yQ-y) 2 . (2.4) 

\ A 

Use  Table  1 to  find  the  value  of  X = X(h,y),  which  is  a function  of  h and 

A A 

y.  Here  X(h,0)  = 0,  and  X(0,y)  = 0.  Then  calculate  the  ML  estimates 


-2- 


(2.5) 


V = y + A(y0-y), 
a = [v+A(y0~y) 2]1^2  . (2.6) 


Locomotive  control  example.  Table  2 below  shows  singly  time  censored 
mileage  data  on  r = 37  failures  in  a sample  of  n = 96  locomotive  controls. 
Management  wanted  an  estimate  and  confidence  limits  for  the  fraction  of  such 
controls  failing  on  an  80  thousand-mile  warranty.  A lognormal  distribution  is 
fitted  to  the  data.  Working  with  the  base  10  logs  of  the  data,  we  find 
y = 1.920696  and  v = 0.03065884.  The  fraction  censored  is  h = (96-37) /96  = 
0.6146,  and  y = 0 .03065884/ [ log(135)-l .920696 ] 2 = 0.697616.  Linear  interpo- 
lation in  Table  1 yields  A = A(0. 6146, 0.697616)  = 1.4387.  Then  the  ML  estimates 

are  u = 1.920696  + 1.4387  [log(135)-l. 920696]  = 2.2223  and  o = {0.03065884+1.4387 
2 1/2 

[log(135)-l. 920696]  } ' = 0.3064. 


Table  Thousands  of  Miles  to  Failure  for  Locomotive 
Controls 


22.5 

57.5 

78.5 

91-5 

113.5 

122.5 

37-5 

66. 5 

80.0 

93-5 

116.0 

123.0 

1+6.  o 

68.  o 

81.5 

102.5 

117.0 

127.5 

1+8.5 

69-5 

82.0 

107.0 

118.5 

131.0 

51.5 

76.5 

83.O 

108.5 

119.0 

132.5 

53-0 

77.0 

8I+.0 

112.5 

120.0 

131+.  0 

5U-5 

Fifty-nine  controls  operated  for  135.0  thousand  miles  with- 
out failure 


Computer  programs.  There  are  computer  programs  that  use  other  means  to 

A /\ 

calculate  p,  o, and  ML  estimates  of  other  quantities.  These  include  STATPAC  by 
Nelson  and  others  (1973),  CENS  by  Hahn  and  Miller  (1968),  the  Maximum  Likelihood 
Program  by  Ross  and  others  (1976),  and  the  IMSL  (1975)  routine  OTMLNR. 

Properties  of  ML  estimates.  ML  estimates  have  good  properties.  For  large  r, 

/V  A 

the  (asymptotic)  joint  cumulative  distribution  of  p and  o is  close  to  a joint 
normal  one  with  means  equal  to  the  true  values  p0  and  oQ  and  (asymptotic) 
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This 


variances  and  covariance  given  by  (3.1)  evaluated  at  u = UQ  and  a = aQ. 

A A 

means  that  y and  O are  approximately  (median)  unbiased.  Also,  no  other  es- 
timates with  asymptotic  normal  distributions  have  smaller  asymptotic  variances. 
This  means  that  the  ML  estimates  are  at  least  as  good  as  any  such  others  for 
large  r.  Also,  for  small  r,  the  ML  estimates  compare  well  with  others. 

Estimate  of  a function.  The  ML  estimate  of  a function  g = g(y  ,o_)  of  the 
^ /v  />>  U 0 0 

parameters  is  g = g(y,o),  that  is,  the  function  evaluated  at  the  ML 

For  example,  the  ML  estimate  of  the  fraction  failing  by  (log)  age  y is 

A A /\ 

F(y ) = <J>[  (y-y)  /o] ; here  $[•]  is  the  standard  normal  cumulative  distribution 
function.  Also,  the  ML  estimate  of  the  lOOP-th  percentile  of  a normal  distri- 

A A A 

bution  is  y^  = y + Zp  a where  zp  is  the  standard  normal  lOOP-th  percentile; 

A 

antilog(yp)  is  the  ML  estimate  of  the  lOOP-th  percentile  of  the  corresponding 
lognormal  distribution. 

A 

For  large  r,  the  (asymptotic)  cumulative  distribution  of  g is  close  to  a 
normal  one  with  mean  gQ  and  variance  (3.5)  evaluated  at  yQ  and  a . This 
means  that  g is  approximately  (median)  unbiased.  Also,  no  other  estimate  with 
an  asymptotic  normal  distribution  has  a smaller  asymptotic  variance. 

Locomotive  control  example.  The  ML  estimate  of  the  fraction  of  controls 
failing  on  an  80  thousand  mile  warranty  is  F(80)  = $[ (log(80)-2. 2223) /0. 3064] 

*=  0.149. 

3.  APPROXIMATE  CONFIDENCE  LIMITS 

This  section  explains  how  to  calculate  approximate  confidence  limits  for 
Uq»  0 , and  other  quantities.  Such  limits  are  good  approximations  when  r is  large. 
Schmee  and  Nelson  (1976)  give  tables  for  exact  limits  for  y^  and  (7^  from  small 
singly  censored  samples.  Also,  Nelson  and  Schmee  (1976a, b)  give  tables  for 
exact  limits  for  (log)  normal  percentiles  and  reliabilities  from  such  samples. 

A A 

Variances  and  covariance  of  u and  Q.  We  first  calculate  estimates  of  the 

A A 

approximate  variances  and  covariance  of  y and  O.  For  large  r,  the  ML  estimates 
of  them  are 


Var(y)  - A(Qo2/n,  Var(o)  - B(£)02/n,  Cov(y,o)  = C(£)o2/n.  (3.1) 


For  time  censored  data. 
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(3.2) 


A A A 

5 = (yQ-y)/o 


Is  the  ML  estimate  cf  the  standardized  deviate  for  the  (log)  censoring  time  y^. 

A 

For  failure  censored  data,  £ is  the  100(r/n)-th  standard  normal  percentile. 

The  factors  A(*),  B(*),  and  C(*)  are  tabled  in  Table  3,  which  is  adapted  from 
Cohen  (1961).  The  percent  labels  on  the  table  let  one  enter  the  table  with 
lOOr/n  to  find  A(*),  B(*)»  and  C(>)  for  failure  censored  samples.  Table  3 
applies  to  right  censored  data. 

/\ 

Locomotive  control  example.  The  standardized  deviate  is  £ = [ log( 135)-2. 2223 ] / 
0.3064  = -0.30015.  By  linear  interpolation,  A(-0. 30015)  = 1.24244,  B(-0. 30015)  = 
0.959079,  and  C(-0. 30015)  = 0.326989.  The  estimates  are 


Var(y)  = 1.24244(0.3064)  /96  = 0.00012150, 


Var(o)  = 0.959079(0.3064)  /96  = 0.00009379, 


A /S  A 


Cov(u,a)  = 0.326989(0.3064)  /96  = 0.00003198. 


Limits  for  uQ  and  ofi.  For  large  r,  two-sided  approximate  100y%  confidence 
limits  for  Uq  are 


/.  /-.  * 1/2  ~ ^ 1/2 
V - M - Ky [Var(n) ] and  p = p + Ky[Var(p)] 


(3.3) 


where  is  the  100(l+y) /2-th  standard  normal  percentile.  Such  limits  for 


are 


A A A 1/9  ^ A A A 1/2  A 

a - a/exp{K^[Var(a) ] /a}  and  o = a«exp{K^[Var (o) ] /a}. 


(3.4) 


To  obtain  such  a one-sided  100y%  confidence  limit  replace  K by  z^  the  lOOy-th 
standard  normal  percentile  in  a limit  above. 


Locomotive  control  example.  Two-sided  approximate  95%  confidence  limits 

1/2 

for  uQ  are  u = 2*2223-1. 960(0. 00012150)  ' = 2.007  and  U = 2.2223+0.0216  = 2.439. 
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Two-sided  approximate  95%  confidence  limits  for  a are  O = 0.3064/ 

1/2  ~ u 

exp[l. 960(0. 00009379)  ' /0. 3064]  = 0.2880  and  a = 0.3064-1.064  = 0.3260. 

Each  limit  is  a one-sided  approximate  97.5%  confidence  limit. 

Limits  for  a function.  The  following  provides  approximate  confidence 
limits  for  the  value  of  a function  g^  = which  has  continuous  first 

derivatives.  For  large  r,  the  ML  estimate  of  the  approximate  variance  of 
g = g(y,o)  is 

Var(g)  = Qg/9y)  2Var(y)  + (9g/9o) 2Var (a)  + 2(9g/9y) (3g/3a)Cov(y,a) ; 

(3.5) 

A A 

here  the  partial  derivatives  are  evaluated  at  y = y and  a = O.  If  the  range 
of  possible  values  of  g is  - °°  to  °°,  two-sided  approximate  100y%  confidence 
limits  for  g()  are 

A /N  /\  1 / 2 0,0  A /V  /\  I / 9 

g - g ~ K^[Var(g)]  and  g = g + K^[Var(g>]  . (3.6) 

If  g must  be  positive,  then  positive  limits  are 

g * g/exp{K^[Var(g)  ]^2/g}  and  g - g • exp{K^[Var (g)  ] 1//2/g}  ; (3.7) 

A 

this  assumes  that  r is  large  enough  that  the  cumulative  distribution  of  ln(g) 
is  approximately  normal.  The  limits  (3.4)  for  aQ  are  positive  ones. 

To  obtain  a one-sided  approximate  100y%  confidence  limit,  use  the  ap- 
propriate limit  above,  but  replace  by  z , the  lOOy-th  standard  normal  per- 
centile. The  previously  mentioned  computer  programs  calculate  such  approximate 
confidence  limits. 

Locomotive  control  example.  Preceding  theory  yields  a one-sided  upper 
95%  confidence  limit  for  the  fraction  of  controls  failing  on  an  80  thousand- 
mile  warranty.  The  fraction  is  F(80)  = 4>{ [log(80)-y ] /a] . z = [log(80)-y] /a 

A A 

is  closer  to  normally  distributed  than  F(80)  = 4>(z).  So  a better  confidence 

A*  ~ A A A 1/2 

limit  for  F(80)  is  F(80)  = <J>(z)  where  z .=  z + z^,[Var(z)]  . The  calculation  of 

Var (z)  from  (3.5)  involves  z = [log(80)-2.2223]/0.3064  = -1.0418,  3z/3 y = -l/o 
and  3z/3a  = - [log(80)-y ] /a2  = -z/a.  Then 
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n 


C'  ^ - 


Var(z)  = (-1/0. 3064) 20. 00012150  + [-(-1.0418) /0 .3064 ] 2 0.00009379 

+ 2(-l/0.3064)  [-(-1.0418) /O. 3064]  0.00003198  = 0.01669. 

~ 1/2 

The  upper  approximate  95%  confidence  limit  is  z = -1.0418  + 1.645(0.01669)  = 

-0.8293  and  F(80)  - $(-0.8293)  = 0.203  . 

4.  MAXIMUM  LIKELIHOOD  THEORY  AND  CALCULATION  OF  THE  TABLES 

This  technical  section  presents  1)  ML  theory  for  Table  1 and  for  fitting 
a normal  distribution  to  data  singly  censored  on  the  right,  2)  the  calculation 
of  Table  1,  and  3)  the  theory  for  the  asymptotic  variances  and  covariances  in 
Table  3.  The  section  includes  the  sample  likelihood,  ML  estimates,  the  Fisher 
information  matrix,  and  the  asymptotic  covariance  matrix  of  the  ML  estimators. 

Maximum  Likelihood  Estimates 

/V  A 

The  ML  estimates  y and  a are  derived  here.  The  likelihood  for  a sample 
of  size  n where  the  first  r failures  <_  . . . £ yr  are  observed  by  time  y^  is 

L = C a~r  <J)[(y1-y)/a]  •••  <J>[ (yr~y) /a]  {l  - $[ (yQ-y) /a] }n-r ; (4.1) 

-1/2  2 

here  <f[z]  = ( 2tt)  exp(-z  /2)  is  the  standard  normal  probability  density  and 
C is  a constant.  (4.1)  applies  to  both  time  and  failure  censored  samples. 

2 ~ -2 

The  ML  estimates  of  y and  a are  the  values  y and  a that  maximize  L. 

They  are  found  by  the  usual  calculus  method  of  setting  equal  to  zero  the  first 

2 

partial  derivatives  of  the  natural  log  of  L with  respect  to  y and  O to  get 
the  likelihood  equations: 

y - y = -oy',  (4.2) 

v + (y-y)2  = a2  (1-CY'),  (4.3) 

where 

£ “ (yQ-y)/a  (4.4) 


is  the  standardized  deviate,  h = (n-r)/n  is  the  fraction  censored,  and 


Y'  = Y’(h,Q  = HO  U-4>(Q]  1 h(l-h)_1  . (4.5) 

A A 

The  solutions  of  (4.2)  and  (4.3)  for  y and  a are  the  ML  estimates  y and  O, 
Following  Cohen  (1959),  we  can  rewrite  (4.2),  (4.3),  and  (4.4)  as 

o2  = v + X(yQ-y)2  , (4.6) 

y = y + X(yQ-y)  , (4.7) 

[1-Y'(^+Y’)]/(S+Y’)2  = v/(yQ-y)2  = y , (4.8) 

and 


X = X(h,D  - Y’(h,e)/[5+Y'(h,0]  • (4.9) 

The  left  side  of  (4.8)  is  function  of  just  £ and  h;  so  (4.8)  can  be  solved 

A A A 

for  ^ as  a function  of  h and  y.  Putting  £ for  £ in  (4.5)  and  (4.9)  yields 

A A,  A A A 

X = X(h,£).  Thus  X is  a function  of  h and  y.  Putting  X for  X in  (4.6)  and 

A 2 a 

(4.7)  yields  a and  y.  The  numerical  calculation  of  the  function  X in 
Table  1 is  described  next. 


Calculation  of  Table  1 

The  calculations  for  Table  1 were  run  on  a GE  600  computer  with  36  bytes 
(8  significant  figures)  in  single  precision. 

A A 

The  main  numerical  calculation  is  to  solve  (4.8)  for  £ for  selected  y 

and  h values.  (4.8)  involves  calculation  of  the  standard  normal  cumulative 

distribution  function  by  Hasting  approximation.  The  accuracy  of  this  routine 
-7  ~ 

is  within  10  . Each  £ was  substituted  into  (4.9)  to  get  the  corresponding 

A A 

X value,  which  is  tabled  for  the  selected  y and  h values.  Results  were  exten- 
sively spot  checked  against  the  table  of  Cooley  and  Cohen  (1970)  where  the 
tables  overlap;  all  results  agreed  to  at  least  six  figures.  (4.8)  was  itera- 

A A 

tively  solved  for  £ by  direct  search  using  a golden  section.  For  fixed  h,  £ 


l-  
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is  a monotone  function  of  y;  so  the  £ for  the  previous  y value  was  used  as  a 

A ^ 

bound  for  the  search  interval.  The  final  £ is  within  +10  of  the  correct 
answer,  except  for  roundoff  in  the  calculation  of  (4.8). 

Asymptotic  Variances  and  Covariance  for  Table  3 

A A 

The  asymptotic  variances  and  covariance  of  p and  0 are  derived  below  for 
time  censored  data.  These  results  are  the  basis  of  Table  3. 

The  log  likelihood  for  the  ith  test  unit  may  be  written  as 

£i  = V”  ^n(21r)-£n(a)-(z.2/2)]  + (1-I±)  [1-*]  ; (4.10) 

here  I.  = 1 if  y.  < yQ  (a  failure  is  observed)  and  1^  = 0 if  y.  > yQ  (the  ob- 
servation is  censored),  = (y^-p)/o  is  the  random  standardized  deviate, 

$ = $(£),  and  £ = (yQ-p) /a  is  the  standardized  censoring  time. 

The  sample  log  likelihood  is 

£ = £.  + ..,+£  . (4.11) 

1 n 

We  need  the  second  partial  derivatives  of  £ with  respect  to  p and  a.  For 
£ they  are 

a^/ap2  = (l/o2){-l.  + (1-Ii)  [C4>(1-4>)_1  - <J>2(l-<i>r2]}  , 

aV/Scr2  = (-1/CT)0 /./3a)  + (l/a2){-2I.z12  + (l-l±)  [-^(l-O)-1 

+ £2(})(1-<J>)~1  - £2<J)2 ( 1— <t>) — 2 ] } , (4.12) 

s^/apao  = (-l/ojo^/au)  + (i/o2){-i1z1 

+ (l-Ii)[£2(Kl-$)'1  - £4>2(1-<I>)-2]  > , 

where  <p  “ <t>(5)«  (4.12)  contains  the  random  quantities  1^  and  z^.  The  elements 

of  the  Fisher  information  matrix  for  unit  i are  the  expectations  of  (4.12)  eva- 
luated for  p * pQ  and  0 = O^,  the  true  parameter  values;  namely. 


(4.13) 


E {-32;£./9y2}  = l/oQ2, 

e{-32<./8o2}  = a/o02){2<f0-c0<f>0[i+c02-c04>0(i-<i>0)~1J}  » 

E{-32^1/8y8a}  = (1/°Q2)  ("V  {l+V  ~1] } 5 


here  = (y0_lJ0)/a0’  ♦o  = and  *0  = $(V* 

These  expectations  are  calculated  from  (4.12)  with  the  aid  of  E{l}  = $q, 
E{9^i/3y)  = E{9;£./9a}  = 0.  By  (4.11),  these  expectations  multiplied  by  n are 
the  expectations  for  the  sample.  In  (4.13),  the  terms  in  { } depend  only  on  Cg- 

The  Fisher  information  matrix 


E{-92*^/3vj2}  E{-92£./9y9a} 

E{-92*r./3y9a}  E{-92^./9a2} 


(4.14) 


A A 

when  inverted  is  the  asymptotic  covariance  matrix  of  y and  a; 


— 

r 

— 

Var(y) 

Cov(y,a) 

= F-1  = (a2/ n) 

> 

/^s 

o 

c(V 

_Cov(y,o) 

Var (a) 

r 

o 

/“S 

vT^ 

O 

'w' 

B(C0) 

namely, 

; (4.15) 


here  A(*)»  B(»),  and  C(*)  depend  only  on  The  asymptotic  covariance 

matrix  for  singly  failure  censored  samples  is  the  same,  but  £q  is  then  the 
100(r/n)-th  standard  normal  percentile. 

Section  3 explains  how  to  use  the  asymptotic  variances  and  covariances 
to  get  approximate  confidence  limits  for  y^  and  and  functions  of  them. 
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